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(54) REPEAT VIDEO SIGNAL ENCODING METHOD AND RECORDING MEDIUM WITH 
RECORDED PROGRAM OF THE METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To determine the 
unit of a parameter adjustment with which a 
better optimization than before in the sense of 
code quantity to noise is performed. 
SOLUTION: A motion detector 01 extracts a 
coding mode and motion vector information 04 of 
an input image signal 02. The information is stored 
in a memory 05 and inputted in a vote device 06. 
A referenced degree 07 is obtained with the vote 
device 06, and stored in a memory 08. In a 
parameter adjustment part 03, the degree of the 
allocation priority of a code quantity 
corresponding to the referenced degree 07 is 
determined, and the allocation priority of the code 
quantity of all small blocks is determined by a 
priority information determination device 09. An 
encoder 10 performs the coding of an input image 
signal 02 based on the information and information 
from the memory 05. A cost evaluation part 1 5 

obtains a Lagrange cost function L based on a code quantity R13 about the whole image 
sequence outputted from the encoder 10 and the total quantity El 4 of noises. When the 
value is minimum, the noise quantity to the code quantity is minimum. Then, a 
convergence decision is performed in a convergence decision part 1 6. 
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Abstract: 

PROBLEM TO BE SOLVED: To determine the unit of a parameter adjustment with which a better optimization 
than before in the sense of code quantity to noise Is performed. SOLUTION: A motion detector 01 extracts a 
coding mode and motion vector information 04 of an input image signal 02. The Information is stored in a 
memory 05 and inputted in a vote device 06. A referenced degree 07 is obtained with the vote device 06, and 
stored In a memory 08. In a parameter adjustment part 03, the degree of the allocation priority of a code 
quantity corresponding to the referenced degree 07 is determined, and the allocation priority of the code 
quantity of all small blocks is determined by a priority information determination device 09. An encoder 10 
performs the coding of an input Image signal 02 based on the information and information from the memory 05. 
A cost evaluation part 15 obtains a Lagrange cost function L based on a code quantity R13 about the whole 
image sequence outputted from the encoder 10 and the total quantity E14 of noises. When the value is 
minimum, the noise quantity to the code quantity is minimum. Then, a convergence decision is performed in a 
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convergence decision part 16. 




JPO Machine translation abstract: 
(57) Abstract 

SUBJECT The unit of the parameter adjustnDent which can perform optimization better than before in the 
meaning of a code amount versus noise is determined. 

Means for SolutionCoding mode and the motion vector information 04 of the input picture signal 02 are 
extracted by the motion detector 01. This information is saved in the memory 05 and inputted into the vote 
machine 06. It asks for the reference degree 07 with the vote machine 06, and is saved in the memory 08. In 
the parameter controller 03, a degree of a code amount quota priority corresponding to the reference degree 07 
is determined, a code amount quota priority of ali the small blocks is determined by the priority information 
determination machine 09, and the input picture signal 02 is coded with the coding equipment 10 based on this 
information and information from the memory 05. Based on the code amount R13 about the whole image 
sequence and the total noise quantity E14 which are outputted from the coding equipment 10, in the cost 
evaluation part 15, when It asks for Lagrange cost function L and this value becomes the minimum, quantity of 
noise over that code amount serves as the minimum. Then, a convergence test Is performed in the convergence 
test part 16. 



Claim(s) 

Claim lln a video signal encoding method which divides a picture into a small block, performs an inter-frame 
motion compensation, and carries out the multiple-times coding of the identical image further, A numerical value 
(it will be henceforth called a reference degree) some of references from other frames of a coding object small 
block using motion vector information A changing procedure, A repetition video signal encoding method having 
the procedure of determining code amount assignment of a coding object small block using this reference 
degree. 

Claim 2In the repetition video signal encoding method according to claim 1, a numerical value (it will be 
henceforth called a reference degree) some of references from other frames of a coding object small block using 
said motion vector information a changing procedure. Processing which votes a predetermined quantity 
according to the attribute of a small block to a field which is an encoding unit, and which the small block is 
referring to within an image comparison frame for every small block, A video signal encoding method having 
processing which adds a value for which Its vote was cast for this every field, and makes that result a reference 
degree of this field, and the processing which repeats this processing in order of an Image frame referred to from 
an image frame which is not referred to any more. 

Claim 3The repetition video signal encoding method comprising according to claim 1: 

A table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 when 
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determining code amount assignment of a coding object small block using a reference degree. 
• A procedure of asking for the Lagrange cost function of a coding object small block from given undetermined 
multipliers, and a procedure which makes the Lagrange cost function the minimum. 

Claim 4The repetition video signal encoding method comprising according to claim 3: 

A procedure of asking for a quantization parameter to which a procedure which makes said Lagrange cost 

function the minimum makes the Lagrange cost function the minimum according to Lagrange's undetermined 

multipliers corresponding to a reference degree of the small block for every small block. 

A procedure of asking for the Lagrange cost function of the whole image sequence, and a procedure which 

changes correspondence of undetermined multipliers of a reference degree and Lagrange, and minimizes the 

Lagrange cost function of the whole image sequence. 

Claim 5A numerical value (it will be henceforth called a reference degree) some of references from other frames 
of a coding object small block using motion vector information A changing procedure, A recording medium which 
recorded a program of a repetition video signal encoding method recording a program for making a computer 
perform a procedure of determining code amount assignment of a coding object small block using this reference 
degree on a recording medium which this computer can read. 

Claim 6A numerical value (it will be henceforth called a reference degree) some of references from other frames 
of a coding object small block using motion vector information a changing procedure, Processing which votes a 
predetermined quantity according to the attribute of a small block to a field which is an encoding unit, and which 
the small block is referring to within an image comparison frame for every small block. Processing which adds a 
value for which its vote was cast for this every field, and makes the result a reference degree of this field, 
Processing which repeats this processing in order of an image frame referred to from an image frame which Is 
not referred to any more, A recording medium which recorded a program of a repetition video signal encoding 
method recording a program for performing a computer on a recording medium which this computer can read. 
Claim 7A table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 
when determining code amount assignment of a coding object small block using a reference degree, A procedure 
of asking for the Lagrange cost function of a coding object small block from given undetermined multipliers, A 
recording medium which recorded a program of a repetition video signal encoding method recording a program 
for making a computer perform a procedure which makes the Lagrange cost function the minimum on a 
recording medium which this computer can read. 

Claim 8A procedure of asking for a quantization parameter to which a procedure which makes the Lagrange cost 
function the minimum makes the Lagrange cost function the minimum according to Lagrange's undetermined 
multipliers corresponding to a reference degree of the small block for every small block, Correspondence of 
undetermined multipliers of a procedure of asking for the Lagrange cost function of the whole Image sequence, 
and a reference degree and Lagrange is changed, A recording medium which recorded a program of a repetition 
video signal encoding method recording a program for making a computer perform a procedure which minimizes 
the Lagrange cost function of the whole Image sequence on a recording medium which this computer can read. 



Detailed Description of the Invention 
0001 

Field of the InventionThls invention relates to the recording medium which recorded the program of a highly 

efficient repetition video signal encoding method and this method. 

0002 

Description of the Prior Artln order to raise coding efficiency In the sense of a code amount versus noise 
quantity, in the video coding method of allowing coding trial of multiple times about an identical image 
sequence, the "Lagrange's method of undetermined multipliers" established in the 18th century is applied to 
evaluation of coding efficiency. They are the total code amount R and all the errors E (by a situation, this 
measure Is a sum of squares with error, or) at the time of sequence coding to the undetermined multipliers 
lambda given from the outside. It asks for valuation-basis L=R+lambda*E from it being an absolute value sum 
with error, and this L performs optimization search (parameter adjustment) In the direction used as the 
minimum. L Is called the Lagrange cost function. 

0003Conventionally, a quantization parameter or Lagrange's undetermined multipliers were set up per frame, 
and it was optimizing by repeating the cycle of parameter adjustment, coding, and code amount versus noise 
quantity evaluation. 
0004 

Problem(s) to be Solved by the Inventionin highly efficient video coding art, such as MPEG-2 (ISO/IEC 
13818-2) used widely now, the frame was divided into the small block and the inter-frame motion compensation 
and the means to code are adopted in this unit. If parameters, such as a quantization step, are Independently 
set for every small block by such a means, the best optimization on theory Is possible, but processing becomes 
huge too much and It is not suitable for practical use (for example, by CCIR 601 picture, 1350 small blocks exist 
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in one frame). When processing by within a time practical , only what uses for each one frame the parameter 
adjusted in the cycle of optimization was proposed. 

OOOBFor example, although Mizuno and others is not a repetition method, The optimal whole frame the amount 
of allocation codes. It has derived (Picture coding.), simposium'99; "A study on bit allocationmethod based on 
rate-distortion properties for different coded picturetypes." .K. Ramchandran and others makes the quantization 
parameter for every frame the optimizing adjustment parameter (IEEE transactions on image processing, Vol.3, 
No. 5, and Septemberl994.) "Bit allocation for dependent quantization with applications to multiresolution and 
MPEG video coders." 

0006AIS0 In which method, the inside of a frame is coded with the unified parameter, consideration of details 
encoding units, such as a small block, is omitted, and there was a fault that the room of optimization will remain 
intrinsically as a result. 

0007Let it be SUBJECT to provide the recording medium which recorded the program of the repetition video 
signal encoding method which determines the unit of the parameter adjustment which can perform optimization 
better than before in the meaning of a code amount versus noise, and this method, this invention having been 
made in light of the above-mentioned circumstances, and maintaining a practical throughput. 
0008 

Means for Solving the Problemin order to attain above-mentioned SUBJECT, in the Ist invention. In a video 
signal encoding method which divides a picture into a small block, performs an inter-frame motion 
compensation, and carries out the multiple-times coding of the identical image further, A numerical value (it will 
be henceforth called a reference degree) some of references from other frames of a coding object small block 
using motion vector information A changing procedure, It is a repetition video signal encoding method having 
the procedure of determining code amount assignment of a coding object small block using this reference 
degree. 

0009AS for the 2nd invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using said motion vector information a changing 
procedure, Processing which votes a predetermined quantity according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame for every 
small block, It is a repetition video signal encoding method having processing which adds a value for which its 
vote was cast for this every field, and makes that result a reference degree of this field, and the processing 
which repeats this processing in order of an image frame referred to from an image frame which is not referred 
to any more. 

OOlOA table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 
when the 3rd invention determines code amount assignment of a coding object small block using a reference 
degree. It is a repetition video signal encoding method having a procedure of asking for the Lagrange cost 
function of a coding object small block from given undetermined multipliers, and a procedure which makes the 
Lagrange cost function the minimum. 

OOllA procedure which makes said Lagrange cost function the minimum the 4th invention for every small block. 
A procedure of asking for a quantization parameter which makes the Lagrange cost function the minimum 
according to Lagrange's undetermined multipliers corresponding to a reference degree of the small block. It Is a 
repetition video signal encoding method having a procedure of asking for the Lagrange cost function of the whole 
image sequence, and a procedure which changes correspondence of undetermined multipliers of a reference 
degree and Lagrange, and minimizes the Lagrange cost function of the whole image sequence. 
0012AS for the 5th invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using motion vector Information A changing 
procedure, A procedure of determining code amount assignment of a coding object small block using this 
reference degree, It is the recording medium which recorded a program of a repetition video signal encoding 
method recording a program for performing a computer on a recording medium which this computer can read. 
0013AS for the 6th invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using motion vector information a changing 
procedure, Processing which votes a predetermined quantity according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame for every 
small block, Processing which adds a value for which its vote was cast for this every field, and makes the result a 
reference degree of this field, Processing which repeats this processing in order of an image frame referred to 
from an image frame which is not referred to any more. It is the recording medium which recorded a program of 
a repetition video signal encoding method recording a program for performing a computer on a recording 
medium which this computer can read. 

0014A table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 
when the 7th invention determines code amount assignment of a coding object small block using a reference 
degree, A procedure of asking for the Lagrange cost function of a coding object small block from given 
undetermined multipliers, It is the recording medium which recorded a program of a repetition video signal 
encoding method recording a program for making a computer perform a procedure which makes the Lagrange 
cost function the minimum on a recording medium which this computer can read. 

0015A procedure which makes the Lagrange cost function the minimum the 8th invention for every small block. 
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A procedure of asking for a quantization parameter which makes the Lagrange cost function the minimum 
according to Lagrange's undetermined multipliers corresponding to a reference degree of the small block, 
Correspondence of undetermined multipliers of a procedure of asking for the Lagrange cost function of the whole 
image sequence, and a reference degree and Lagrange is changed, It is the recording medium which recorded a 
program of a repetition video signal encoding method recording a program for making a computer perform a 
procedure which minimizes the Lagrange cost function of the whole image sequence on a recording medium 
which this computer can read. 

0016AS mentioned above, in this invention, it asks for inter-frame reference relation from motion vector 
information of a picture, and coding importance for every picture small block is determined based on this. 
0017In advance of processing, a picture is coded once, and motion compensation information and encoded 
mode information are determined. Quantity suitably defined according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame using the 
motion vector information for every small block Is voted. 

OOlSFor example, if it is a bidirectional prediction macro block, "\/= 0.5" will be voted, respectively to each 
reference region in a frame (before or after two sheets) currently referred to. If it is a forward direction 
prediction macro block, "V (=Vq+1)" will be voted for a time target which is referring to It to a reference region 

in the past frame (one sheet). Vq Is a voting value already stored In an adding machine of this small block here. 

If it is the Intra (formation of frame inner code) macro block, since all picture signal is not referred to, either, 
vote will not be performed. 

0019For example, although a small block which is called skipped macro block and to which coding was 
abbreviated may exist in MPEG-2, this casts its vote by ****(ing) with those without a motion (motion vectors 
are (0, 0)). Although a motion vector called concealment motion vector may be added to the Intra macro block, 
this motion vector ignores and vote is not performed. 

OOZOVote performed here is a two-dimensional thing using a two-dimensional array-like adding machine 
prepared for every frame. For example, since a reference degree of a whole block in the B frame (bidirectional 
prediction frame) of MPEG-2 is always "0", an adding machine is omissible. Since there is a whole block in the I 
frame (frame inner code-ized frame) by frame inner code-ization, voting operation is omissible about the frame. 
An adding machine is altogether initialized to "0" before voting operation. 

0021In the case of a method using a parallel translation model like MPEG-2 grade, a voting value is added to 
within the limits of the same shape as a small block, and a size. In the case of a method using affine and a 
transparent transformation model, a voting value is added like MPEG-4 Version 2 (ISO/IEC14496-2AMD1) into a 
field which transformed small block shape Inversely, the latter — a case -- vote — a field — area — S -- ^ — 

general — a small block — area -- S — .. — differing — since — a voting value -- V — having carried out — the 
time — for example — v — ' — = — V*Sjj .. — /— S — ^ .. — like — having corrected — a voting value — v — ' — 
using . 

0022The two-dimensional adding machine arrangement used here can consider composition corresponding to 1 
pixel In one adding machine, composition corresponding to 1 small block in one adding machine, etc., for 
example. In the case of the former, a voting value is added, for example to a full adder in a vote field at the time 
of vote. In the case of the latter, only a rate of area of having lapped is added to a full adder with which a small 
block has lapped with a vote field at the time of vote. That is, an aggregate value will become V*Sq/S^ if area 

which has lapped area of V and a vote field with a field of and this adding machine in a voting value is made 

into Sq. This situation is shown in drawing 1. In an example shown In drawing 1, a view small block of a 

prediction frame is straddling four small blocks of a reference frame, Since area which laps with each is 0.07\/- 
0.26V-0.15V-0.52\/ in order of the right and a top to the bottom from the left when small block area is set to 
"1", It is added to an adding machine (at drawing 1, a symbol of "-" shows an adding machine) with which these 
values correspond. This voting operation is repeated bottom-up in low order of a degree referred to from a frame 
which is not referred to any more. This situation is shown in drawing 2. 

0023Ballot results about a degree referred to are accumulated by this processing about an adding machine in all 
the small blocks within an encoding object image signal. When one adding machine supports 1 pixel, let total of 
ballot results which Is an output of a full adder In a small block, for example be a reference degree of the small 
block. When one adding machine supports 1 small block, let the output value of an adding machine itself be a 
reference degree. Since a voting value is always set to "0" about the B frame which is not referred to from 
others, an adding machine may be omitted. 

0024In each small block, a parameter which embodies dignity at the time of bigger coding Is given, so that this 
reference degree Is high. Although matching of this reference degree and a parameter Is arbitrary, it is 
considered as a parameter which smaller coding noise or more code amounts generate to a higher reference 
degree. For example, It Is possible to make more the undetermined multipliers lambda or the amount of 
allocation codes itself of a smaller quantization parameter or bigger Lagrange etc. A reference degree asks for a 
quantization parameter about a small block of "0", for example using the Lagrange undetermined multipliers (it 
is considered as lambdag) themselves given to the whole sequence. 

0025A code amount of a small block Namely, Rq, When an error is made Into Eq (It shall normalize so that it 
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may both be proportional to quantity per one frame or 1 sequence). A quantization parameter which mal<es the 
minimum Lagrange cost function Lq defined by LQ=RQ+lambdaQ*EQ is used for coding of the small block. This 

parameter is adjusted one by one, and it optimizes so that evaluation quantity L of the whole sequence may be 
made Into the minimum. 

0026In order to make Into the minimum Lagrange cost function L mentioned above, optimization is attained by 
the following double loops. 

00270utside loop: Adjust correspondence (line graph control point shown in drawing 4) of a reference degree 
and lambda. Inner loop: AskiQr,a,^uantiza tion para met er which makes L the.minimum acc ording to lambda 
corresponding to a reference degree of the smalTblock as a round robin for every smafr&Iocl<r ' 
0028When a code amount, a quantization parameter, or Lagrange's undetermined multipliers are given for 
every frame like before, Even If a small region which is not referred to at all Is In I or p frames (forward direction 
prediction frame) or a small region referred to very frequently is in a certain p frames, To the ability to have not 
taken into consideration in code amount assignment, by an upper description poor method, many code amounts 
can be assigned and encoding efficiency of the whole sequence improves as a result from small BUROKKUHE 
with a higher reference degree. 

0029S ince parameter adjustment and optimization are performed accordin g to a reference degree of a smajl[ 
block, different code amount assignment for every smj irgloc k Is realized, ^ut a parameter Is^made to 
'correspond to all the smamjlocks oi^ an Image sequence7"aTld^an operation amount becomes small substantially 
compared with carrying out optimization search. 
0030 

Embodiment of the InventionAn embodiment of the invention is described based on Drawings below. Drawing 
3 is a flow chart of the procedure of the encoding method which describes an embodiment of the invention, and 
extracts the coding mode and the motion vector information 04 of the input picture signal 02 in the motion 
detector 01 first in drawing 3. Coding is not performed in^TRlFstage. This information is saved in the memory 05, 
and is inputted into the vote machine 06. The vote machine 06 asks for the reference degree 07 from coding 
mode and the motion vector information 04. The called-for reference degree 07 Is saved in the memory 08. 
0031In the parameter controller 03, the degree of the code amount quota priority corresponding to this 
reference degree 07 is determined. For example, the one undetermined multipliers lambda of Lagrange are 
made to correspond to one reference degree by the line graph determined like drawing 4 at two or more control 
points. When a reference degree is "0", it is considered as lambdaQ equal to the undetermined multipliers of the 

whole picture. In order to make a higher code amount quota priority correspond, the constraint which certainly 
makes the line graph shown in drawing 4 an upward slant to the right, for example can be used for a small block 
with a higher reference degree. 

0032In order to change a certain reference degree into undetermined multipliers, the table which made the 
undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 may be used. In this case, 
when the reference degree 07 has a beam below a decimal point, the size of a table can be stopped by rounding 
off with a suitable beam. In the priority information determination machine 09, the code amount quota priority 
(Lagrange's undetermined multipliers) of all the small blocks is determined using this matching Information. 
0033Based on this information and the preservation motion vector information from the memory 05, the input 
picture signal 02 Is again coded In the loop inner code-ized machine 10. Namely, about a certain small block, 
supposing Lagrange's undetermined multipliers given from the priority Information 09 are lambdag. It asks for a 

quantization parameter which makes the minimum Lagrange cost function LL=R3+lambdaQEQ (however, R the 

number of bits of this small block and E decoding error of this small block) about the block as a round robin, for 
example. The bit stream output 11 is overwritten at the storage medium 12. 

0034In the cost evaluation part 15, it asks for Lagrange cost function L as L=R+lambdaQE based on the code 

amount R13 about the whole image sequence and the total noise quantity E14 which are outputted from the 
coding equipment 10. When this value becomes the minimum, the quantity of the noise over that code amount 
serves as the minimum. Then, a convergence test is performed in the convergence test part 16. For example, 
processing is ended when judged with having fulfilled the condition of convergence — change is not looked at by 
Lagrange cost function L. 

00350therwise, correspondence of the reference degree 07 and a code amount quota priority Is again adjusted 
by the parameter controller 03 (the control point of drawing 4 is moved in practice, or the table which makes the 
undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 is corrected), and the loop of 
coding / evaluation / judgment is repeated. The bit stream saved at the storage medium 12 at the time of the 
end of processing turns into optimal desired bit stream. 

0036At comparatively high speed, in order not to search this embodiment by moving by the coding equipment 
10 within a loop, coding Is performed repeatedly. Although the coding which considered selection of the coding 
modes (bidirectional prediction / forward direction prediction / skip) of a motion vector or a small block as 
Immobilization is performed by the picture encoder within a loop at this embodiment, the composition which puts 
motion detection and a mode select portion in a loop is also possible. In this case, if the convergence test in the 
convergence test part 16 Is "No", control will move to Just before instead of immediately after the motion 
detector 01 . 
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0037It cannot be overemphasized that a computer can be made to perform each procedure shown by drawing 
3, To a computer the program for performing the procedure The recording medium which the computer can 
read, For example, it records on FD (floppy (registered trademarl<) disl<), MO, ROM, a memory card, CD, DVD, a 
removable disc, etc., and it provides and distributing is possible. 
0038 

Effect of the InventionAs stated above, according to this invention, optimal code amount assignment can be 
performed more by details rather than setting a parameter for every frame type. Since parameter adjustment 
and optimization are performed according to the reference degree of a small block, different code amount 
assignment for every small block is realized, but compared with making a parameter correspond to all the small 
blocks of an image sequence, and carrying out optimization search, an operation amount becomes small 
substantially. 



Field of the InventlonThis invention relates to the recording medium which recorded the program of a highly 
efficient repetition video signal encoding method and this method. 



Description of the Prior Artin order to raise coding efficiency in the sense of a code amount versus noise 
quantity, in the video coding method of allowing coding trial of multiple times about an identical image 
sequence, the "Lagrange's method of undetermined multipliers" established in the 18th century is applied to 
evaluation of coding efficiency. They are the total code amount R and all the errors E (by a situation, this 
measure Is a sum of squares with error, or) at the time of sequence coding to the undetermined multipliers 
lambda given from the outside. It asks for valuation-basis L=R+lambda*E from it being an absolute value sum 
with error, and this L performs optimization search (parameter adjustment) in the direction used as the 
minimum. L is called the Lagrange cost function. 

OOOSConventionally, a quantization parameter or Lagrange's undetermined multipliers were set up per frame, 
and it was optimizing by repeating the cycle of parameter adjustment, coding, and code amount versus noise 
quantity evaluation. 



Effect of the InventionAs stated above, according to this invention, optimal code amount assignment can be 
performed more by details rather than setting a parameter for every frame type. Since parameter adjustment 
and optimization are performed according to the reference degree of a small block, different code amount 
assignment for every small block Is realized, but compared with making a parameter correspond to all the small 
blocks of an image sequence, and carrying out optimization search, an operation amount becomes small 
substantially. 



Probiem(s) to be Solved by the Inventionin highly efficient video coding art, such as MPEG-2 (ISO/IEC 
13818-2) used widely now, the frame was divided into the small block and the inter-frame motion compensation 
and the means to code are adopted in this unit. If parameters, such as a quantization step, are independently 
set for every small block by such a means, the best optimization on theory is possible, but processing becomes 
huge too much and it is not suitable for practical use (for example, by CCIR 601 picture, 1350 small blocks exist 
in one frame). When processing by within a time practical , only what uses for each one frame the parameter 
adjusted in the cycle of optimization was proposed. 

OOOSFor example, although Mizuno and others is not a repetition method. The optimal whole frame the amount 
of allocation codes. It has derived (Picture coding.), simposium'99, "A study on bit allocationmethod based on 
rate-distortion properties for different coded picturetypes." .K. Ramchandran and others makes the quantization 
parameter for every frame the optimizing adjustment parameter (IEEE transactions on image processing, Vol.3, 
No. 5, and Septemberl994.) "Bit allocation for dependent quantization with applications to multiresolution and 
MPEG video coders." 

0006AISO In which method, the inside of a frame is coded with the unified parameter, consideration of details 
encoding units, such as a small block, is omitted, and there was a fault that the room of optimization will remain 
intrinsically as a result. 

0007Let it be SUBJECT to provide the recording medium which recorded the program of the repetition video 
signal encoding method which determines the unit of the parameter adjustment which can perform optimization 
better than before in the meaning of a code amount versus noise, and this method, this invention having been 
made in light of the above-mentioned circumstances, and maintaining a practical throughput. 
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Means for Solving the Problemin order to attain above-mentioned SUBJECT, in the 1st invention. In a video 
signal encoding nnethod which divides a picture into a small block, performs an inter-frame motion 
compensation, and carries out the multiple-times coding of the identical Image further, A numerical value (it will 
be henceforth called a reference degree) some of references from other frames of a coding object small block 
using motion vector information A changing procedure. It is a repetition video signal encoding method having 
the procedure of determining code amount assignment of a coding object small block using this reference 
degree. 

0009AS for the 2nd invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using said motion vector information a changing 
procedure, Processing which votes a predetermined quantity according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame for every 
small block. It is a repetition video signal encoding method having processing which adds a value for which its 
vote was cast for this every field, and makes that result a reference degree of this field, and the processing 
which repeats this processing in order of an image frame referred to from an image frame which is not referred 
to any more. 

OOlOA table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 
when the 3rd invention determines code amount assignment of a coding object small block using a reference 
degree. It is a repetition video signal encoding method having a procedure of asking for the Lagrange cost 
function of a coding object small block from given undetermined multipliers, and a procedure which makes the 
Lagrange cost function the minimum. 

OOllA procedure which makes said Lagrange cost function the minimum the 4th invention for every small block. 
A procedure of asking for a quantization parameter which makes the Lagrange cost function the minimum 
according to Lagrange's undetermined multipliers corresponding to a reference degree of the small block. It is a 
repetition video signal encoding method having a procedure of asking for the Lagrange cost function of the whole 
image sequence, and a procedure which changes correspondence of undetermined multipliers of a reference 
degree and Lagrange, and minimizes the Lagrange cost function of the whole image sequence. 
0012AS for the 5th invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using motion vector information A changing 
procedure, A procedure of determining code amount assignment of a coding object small block using this 
reference degree. It is the recording medium which recorded a program of a repetition video signal encoding 
method recording a program for performing a computer on a recording medium which this computer can read. 
0013AS for the 6th invention, a numerical value (it will be henceforth called a reference degree) some of 
references from other frames of a coding object small block using motion vector information a changing 
procedure. Processing which votes a predetermined quantity according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame for every 
small block, Processing which adds a value for which Its vote was cast for this every field, and makes the result a 
reference degree of this field, Processing which repeats this processing in order of an image frame referred to 
from an image frame which is not referred to any more, It is the recording medium which recorded a program of 
a repetition video signal encoding method recording a program for performing a computer on a recording 
medium which this computer can read. 

0014A table which makes undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 
when the 7th invention determines code amount assignment of a coding object small block using a reference 
degree, A procedure of asking for the Lagrange cost function of a coding object small block from given 
undetermined multipliers. It is the recording medium which recorded a program of a repetition video signal 
encoding method recording a program for making a computer perform a procedure which makes the Lagrange 
cost function the minimum on a recording medium which this computer can read. 

0015A procedure which makes the Lagrange cost function the minimum the 8th invention for every small block. 
A procedure of asking for a quantization parameter which makes the Lagrange cost function the minimum 
according to Lagrange's undetermined multipliers corresponding to a reference degree of the small block, 
Correspondence of undetermined multipliers of a procedure of asking for the Lagrange cost function of the whole 
image sequence, and a reference degree and Lagrange is changed, It is the recording medium which recorded a 
program of a repetition video signal encoding method recording a program for making a computer perform a 
procedure which minimizes the Lagrange cost function of the whole image sequence on a recording medium 
which this computer can read. 

0016AS mentioned above, in this invention, it asks for inter-frame reference relation from motion vector 
information of a picture, and coding importance for every picture small block is determined based on this. 
0017In advance of processing, a picture is coded once, and motion compensation information and encoded 
mode information are determined. Quantity suitably defined according to the attribute of a small block to a field 
which is an encoding unit, and which the small block is referring to within an image comparison frame using the 
motion vector information for every small block is voted. 

OOlSFor example, if it is a bidirectional prediction macro block, "V= 0.5" will be voted, respectively to each 
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reference region in a frame (before or after two sheets) currently referred to. If it is a forward direction 
• iJredlctlon macro block, "V (=Vq+1)" will be voted for a time target which Is referring to It to a reference region 
in the past frame (one sheet). Vq is a voting value already stored in an adding machine of this small block here. 
If it Is the Intra (formation of frame inner code) macro block, since all picture signal is not referred to, either, 
vote will not be performed. 

0019For example, although a small block which is called skipped macro block and to which coding was 
abbreviated may exist in MPEG-2, this casts its vote by ****(ing) with those without a motion (motion vectors 
are (0, 0)). Although a motion vector called concealment motion vector may be added to the Intra macro block, 
this motion vector Ignores and vote is not performed. 

0020Vote performed here is a two-dimensional thing using a two-dimensional array-like adding machine 
prepared for every frame. For example, since a reference degree of a whole block in the B frame (bidirectional 
prediction frame) of MPEG-2 Is always "0", an adding machine is omissible. Since there is a whole block in the I 
frame (frame Inner code-lzed frame) by frame inner code-ization, voting operation is omissible about the frame. 
An adding machine is altogether initialized to "0" before voting operation. 

0021In the case of a method using a parallel translation model like MPEG-2 grade, a voting value is added to 
within the limits of the same shape as a small block, and a size. In the case of a method using affine and a 
transparent transformation model, a voting value is added like MPEG-4 Version 2 (ISO/IEC14496-2AMD1) into a 
field which transformed small block shape inversely, the latter - a case — vote - a field - area - S - ^ „ — 
general - a small block area — S -- -- differing -- since — a voting value - V -- having carried out — the 
time - for example — v — ' — = — V*Sjj „ — /— S — ^ _. — like — having corrected a voting value — V — ' — 
using . 

0022The two-dimensional adding machine arrangement used here can consider composition corresponding to 1 
pixel in one adding machine, composition corresponding to 1 small block In one adding machine, etc., for 
example. In the case of the former, a voting value Is added, for example to a full adder in a vote field at the time 
of vote. In the case of the latter, only a rate of area of having lapped is added to a full adder with which a small 
block has lapped with a vote field at the time of vote. That is, an aggregate value will become V*SQ/Sy if area 
which has lapped area of V and a vote field with a field of and this adding machine in a voting value is made 
into Sq. This situation Is shown in drawing 1. In an example shown in drawing 1, a view small block of a 

prediction frame is straddling four small blocks of a reference frame. Since area which laps with each is 0.07\/- 
0.26\/-0.15V-0.52V in order of the right and a top to the bottom from the left when small block area is set to 
"1", it is added to an adding machine (at drawing 1, a symbol of "-" shows an adding machine) with which these 
values correspond. This voting operation Is repeated bottom-up in low order of a degree referred to from a frame 
which is not referred to any more. This situation is shown In drawing 2. 

0023Ballot results about a degree referred to are accumulated by this processing about an adding machine in all 
the small blocks within an encoding object image signal. When one adding machine supports 1 pixel, let total of 
ballot results which Is an output of a full adder in a small block, for example be a reference degree of the small 
block. When one adding machine supports 1 small block, let the output value of an adding machine itself be a 
reference degree. Since a voting value Is always set to "0" about the B frame which is not referred to from 
others, an adding machine may be omitted. 

0024In each small block, a parameter which embodies dignity at the time of bigger coding is given, so that this 
reference degree is high. Although matching of this reference degree and a parameter is arbitrary, It is 
considered as a parameter which smaller coding noise or more code amounts generate to a higher reference 
degree. For example, It Is possible to make more the undetermined multipliers lambda or the amount of 
allocation codes itself of a smaller quantization parameter or bigger Lagrange etc. A reference degree asks for a 
quantization parameter about a small block of "0", for example using the Lagrange undetermined multipliers (it 
is considered as lambda^) themselves given to the whole sequence. 

0025A code amount of a small block Namely, Rq, When an error Is made into Eq (it shall normalize so that it 

may both be proportional to quantity per one frame or 1 sequence). A quantization parameter which makes the 
minimum Lagrange cost function Lq defined by LQ=RQ+lambdaQ*EQ is used for coding of the small block. This 

parameter is adjusted one by one, and it optimizes so that evaluation quantity L of the whole sequence may be 
made into the minimum. 

0026In order to make into the minimum Lagrange cost function L mentioned above, optimization is attained by 
the following double loops. 

00270utside loop: Adjust correspondence (line graph control point shown in drawing 4) of a reference degree 
and lambda. Inner loop: Ask for a quantization parameter which makes L the minimum according to lambda 
corresponding to a reference degree of the small block as a round robin for every small block. 
0028When a code amount, a quantization parameter, or Lagrange's undetermined multipliers are given for 
every frame like before, Even if a small region which is not referred to at all is in I or p frames (forward direction 
prediction frame) or a small region referred to very frequently is In a certain p frames, To the ability to have not 
taken into consideration In code amount assignment, by an upper description poor method, many code amounts 
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can be assigned and encoding efficiency of the whole sequence improves as a result from small BUROKKUHE 
^ith a higher reference degree. 

0029Since parameter adjustment and optimization are performed according to a reference degree of a small 
block, different code amount assignment for every small block is realized, but a parameter is made to 
correspond to all the small blocks of an image sequence, and an operation amount becomes small substantially 
compared with carrying out optimization search. 
0030 

Embodiment of the InventionAn embodiment of the invention Is described based on Drawings below. Drawing 
3 is a flow chart of the procedure of the encoding method which describes an embodiment of the invention, and 
extracts the coding mode and the motion vector information 04 of the Input picture signal 02 in the motion 
detector 01 first in drawing 3. Coding is not performed In this stage. This information is saved in the memory 05, 
and is inputted into the vote machine 06. The vote machine 06 asks for the reference degree 07 from coding 
mode and the motion vector information 04. The called-for reference degree 07 is saved in the memory 08. 
0031In the parameter controller 03, the degree of the code amount quota priority corresponding to this 
reference degree 07 is determined. For example, the one undetermined multipliers lambda of Lagrange are 
made to correspond to one reference degree by the line graph determined like drawing 4 at two or more control 
points. When a reference degree is "0", it is considered as lambdaQ equal to the undetermined multipliers of the 
whole picture. In order to make a higher code amount quota priority correspond, the constraint which certainly 
makes the line graph shown in drawing 4 an upward slant to the right, for example can be used for a small block 
with a higher reference degree. 

0032In order to change a certain reference degree into undetermined multipliers, the table which made the 
undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 may be used. In this case, 
when the reference degree 07 has a beam below a decimal point, the size of a table can be stopped by rounding 
off with a suitable beam. In the priority information determination machine 09, the code amount quota priority 
(Lagrange's undetermined multipliers) of all the small blocks is determined using this matching information. 
0033Based on this information and the preservation motion vector information from the memory 05, the input 
picture signal 02 is again coded in the loop inner code-ized machine 10. Namely, about a certain small block, 
supposing Lagrange's undetermined multipliers given from the priority information 09 are lambdag. It asks for a 

quantization parameter which makes the minimum Lagrange cost function LL=Rg+lambdagEg (however, R the 

number of bits of this small block and E decoding error of this small block) about the block as a round robin, for 
example. The bit stream output 11 is overwritten at the storage medium 12. 

0034In the cost evaluation part 15, it asks for Lagrange cost function L as L=R+lambdaQE based on the code 

amount R13 about the whole image sequence and the total noise quantity E14 which are outputted from the 
coding equipment 10. When this value becomes the minimum, the quantity of the noise over that code amount 
serves as the minimum. Then, a convergence test is performed in the convergence test part 16. For example, 
processing Is ended when judged with having fulfilled the condition of convergence — change is not looked at by 
Lagrange cost function L. 

00350therwise, correspondence of the reference degree 07 and a code amount quota priority Is again adjusted 
by the parameter controller 03 (the control point of drawing 4 is moved in practice, or the table which makes the 
undetermined multipliers of a reference degree and Lagrange correspond to 1 to 1 is corrected), and the loop of 
coding / evaluation / judgment is repeated. The bit stream saved at the storage medium 12 at the time of the 
end of processing turns Into optimal desired bit stream, 

0036At comparatively high speed, in order not to search this embodiment by moving by the coding equipment 
10 within a loop, coding is performed repeatedly. Although the coding which considered selection of the coding 
modes (bidirectional prediction / forward direction prediction / skip) of a motion vector or a small block as 
Immobilization is performed by the picture encoder within a loop at this embodiment, the composition which puts 
motion detection and a mode select portion in a loop is also possible. In this case, if the convergence test In the 
convergence test part 16 is "No", control will move to just before instead of immediately after the motion 
detector 01 . 

0037It cannot be overemphasized that a computer can be made to perform each procedure shown by drawing 
3, To a computer the program for performing the procedure The recording medium which the computer can 
read. For example, it records on FD (floppy (registered trademark) disk), MO, ROM, a memory card, CD, DVD, a 
removable disc, etc., and it provides and distributing is possible. 



Brief Description of the Drawings 

Drawing lit Is an explanatory view showing the situation of the vote to an adding machine in case one adding 
machine corresponds to a small block. 

Drawing 2It is an explanatory view which describes the flow of bottom-up vote operation and summing 
processing. 

Drawing 3It is a procedure figure of an encoding method showing the embodiment of this invention. 
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Drawing 4It is a matching graph of a reference degree and an encoding priority in the embodiment of this 
* Invention. 
Description of Notations 

01 — Motion detector 

02 — Input picture signal 

03 — Parameter controller 

04 — Coding mode and motion vector information 

05 — Memory 

06 - Vote machine 

07 " Reference degree 

08 — Memory 

09 — Priority information determination machine 

10 — Coding equipment 
12 — Storage medium 

15 — Cost evaluation part 

16 — Convergence test part 



Drawing 1 

For drawings please refer to the original document. 

Drawing 2 

For drawings please refer to the original document. 
Drawing 3 

For drawings please refer to the original document. 
Drawing 4 

For drawings please refer to the original document. 



For drawings please refer to the original document. 
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